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APPLYING  PHOTOGRAMMETRY  TO  REAL 
TIME  COLLECTION  OF  DIGITAL  IMAGE  DATA 


The  purpose  of  the  research  was  to  explore  the  possibility  of  using  photogrammetric 
techniques  as  an  aid  in  real  time  attitude  stabilization,  cruise  missile  control,  and 

terrain  mapping  when  image  data  is  collected  digitally  rather 
INTRODUCTION  than  by  conventional  film  methods.  The  fundamental  con¬ 
cepts  of  x-parallax  and  y-parallax  were  used  to  measure 
terrain  heights  and  system  attitude  deviations,  respectively.  Epipolar  line  correlation 
was  used  to  measure  x-parallax  and  the  coplanarity  relation  was  used  to  control 
y-parallax.  Two  digital  image  sensing  modes  were  considered.  In  the  first  mode,  data 
was  collected  in  a  manner  similar  to  a  conventional  strip  camera;  in  the  second  mode, 
data  was  collected  in  a  manner  similar  to  a  conventional  chimney-type  panoramic 
camera.  Tests  were  conducted  with  digitized  stereo  image  data.  The  tests  were  designed 
to  evaluate  three  measures  of  similarity  in  epipolar  image  matching  and  to  evaluate 
y-parallax  as  a  measure  of  relative  attitude  control. 


It  was  assumed  in  this  study  that  the  digital  imaging  system  was  composed  of  a  solid 
state  linear  array  of  detectors  configured  in  a  vehicle  such  that  the  image  data  was 
collected  in  a  manner  amenable  to  efficient  stereo  processing.  It  was  intended  that  the 
sensed  data  be  used  to  compute  elevation  data  in  real  time  for  mapping  purposes  or  to 
control  a  cruise  missile  in  flight.  Results  indicate  that  a  more  practical  use  would  be  to 
produce  stereo  image  data  ready  for  direct  input  to  existing  stereo  compilation  equip¬ 
ment. 


Two  digital  stereo  image  sensor  systems  are  described  in  this  section  primarily  to  help 

describe  the  role  of  two  photogrammetric 
DESCRIPTION  OF  TWO  DIGITAL  operations  in  determining  ground  ele- 
SENSOR  CONFIGURATIONS  vations  and  in  supporting  attitude  control. 

The  two  imaging  systems  are  described  in 
a  general  way;  a  more  thorough  geometric  description  is  presented  in  the  appendixes. 
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Model  1  ■  This  system,  where  two  camera  frames  are  locked  together,  is  the  sim¬ 

pler  of  the  two.  In  each,  a  linear  array  of  solid  state  detectors  is  arranged  in  the  focal 
plane  so  that  the  extent  of  the  array  is  perpendicular  to  the  flight  path.  This  system 
provides  continuous  stereo  coverage  of  a  narrow  band  of  terrain  along  the  vehicle 
ground  track.  If  the  relative  attitude  of  the  camera  complex  remains  constant  over 
time,  then  the  Jth  detector  pair  (one  from  each  linear  array)  produces  a  stream  of 
epipolar  data  that  can  be  used  to  compute  elevation  data  either  in  real  time  or  later 
using  conventional  compilation  practices  (see  appendix  E  for  a  description  of 
epipolar  correlation).  Note  that  in  this  model  the  Jth  detector  defines  the  Jth 
epipolar  plane. 

The  relative  attitude  of  the  camera  complex  pertains  to  the  relative  attitude  of  the 
forward  camera  at  time  T  and  the  aft  camera  at  time  T  +  DT  +  6XJ  when  the  two 
imaging  rays  defined  by  the  Jth  detectors  intersect  the  ground  and,  if  all  is  well, 
one  another.  The  time  interval  DT  corresponds  to  a  fixed  elevation  and  6T  pertains 
to  time  deviations  about  DT  owing  to  the  undulating  terrain.  The  relative  geometry 
should  remain  constant  for  all  6T .  Deviations  from  the  desired  relative  geometry 
can  be  detected  by  measuring  y-parallax. 


The  y-parallax,  including  its  measurement,  is  described  in  appendix  D.  It  is  a  mea¬ 
sure  of  the  lack  of  coplanarity  of  the  baseline  and  the  estimated  imaging  rays.  If  the 
output  from  the  forward  array  is  held  in  the  x-parallax  calculation,  then  any  y- 
parallax  -  significantly  different  from  zero  -  can  be  attributed  to  a  change  in  re¬ 
lative  orientation.  The  y-parallax  can  be  measured  for  several  of  the  detectors  over 
the  linear  format  for  input  to  a  Kalman  filter.  The  output  of  the  filter  would  be 
corrections  to  the  relative  orientation  parameters  at  time  (T  =  DT/2). 


Model  2  ■  Model  2  differs  from  Model  1  in  that  the  camera  frames  are  not 

locked  together.  Each  linear  array  of  detectors  is  free  to  scan.  The  arrays  are  arranged 
in  the  focal  plane  so  that  the  extent  of  the  arrays  is  parallel  to  the  flight  path.  This 
system  provides  continuous  stereo  coverage  of  a  wide  band  of  terrain  along  the  vehicle 
ground  track.  Continuous  ground  coverage  along  the  track  can  be  obtained  by  de¬ 
signing  the  exposure  interval  so  that  digital  stereo  pairs  either  abut  or  overlap. 
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The  cameras  scan  across  the  flight  path  to  acquire  ground  coverage  while  at  the  same 
time  they  yaw  about  their  optical  axes  so  that  the  detector  output  from  both  cameras 
for  the  same  scan  angle  will  be  corresponding  epipolar  data.  If  both  cameras  scan  in 
unison  then  epipolar  data  are  collected  at  the  same  instant.  If  the  two  cameras  scan  in 
opposite  directions  to  cancel  vehicle  rotational  effects  then  epipolar  data  are  collected 
at  different  times.  If  the  two  cameras  scan  in  unison,  then  the  y-parallax  calculations 
discussed  for  Model  1  apply.  The  major  difference  here  is  that  the  output  of  the 
Kalman  filter  would  be  used  to  correct  relative  orientation  parameters  at  time  T, 
the  time  of  scan.  If  the  two  cameras  scan  in  opposite  directions,  then  the  output  of 
the  filter  would  be  used  to  correct  the  relative  orientation  parameters  at  a  time  midway 
between  the  two  exposures. 


The  digitized  image  used  for  this  experiment  is  stored  in  the 
NUMERICAL  DIAL  (Digital  Image  Analysis  Laboratory) system 1  and  is 
EXPERIMENTS  described  in  a  previous  ETL  research  note.2  The  digitized 
image  is  a  subimage  taken  from  an  exposure  of  rugged 
terrain.  The  essential  features  of  the  digitized  model  are 


EXPOSURE  DATA 


Camera  Type:  Vertical  frame 

Focal  Length:  6  inches  (15.2  cm) 


Scale:  1 :48,000 


'  Lawrence  A.  Gambino  and  Bryce  L.  Schrock.  "An  E  xperimental  Digital  Interactive  f  acility,”  Computer,  Vol. 
10.  No.  8,  August  1977.  pp.  22-28. 

2 

Michael  A.  Crombie,  Stereo  Analysis  of  a  Specific  Digital  Model  Sampled  From  Aerial  Imagery,  U.S.  Army 
I  ngineer  Topographic  Laboratories.  I  ort  Hclvoir.  VA.  KTL-0072,  September  1976,  AD-A033  567. 
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DIGITAL  DATA 


Lmage  Dimension: 
Grayshades: 

Aperture  Size: 

Sample  and  Line  Spacing: 


2048  x  2048 
256 

34.5  pm  (micrometers) 
24  pm 


Three  numerical  experiments  were  performed.  The  first  was  an  autocorrelation  test 
designed  to  evaluate  three  basic  measures  of  similarity  (see  appendix  F.)  when  used 
to  register  corresponding  epipolar  data.  The  second  experiment  was  an  evaluation  of 
the  same  measures  of  similarity,  but  in  a  stereo  mode.  The  third  experiment  was  a 
demonstration  of  how  the  lack  of  correspondence  between  lines  of  image  data  can 
be  detected  and  measured  by  estimating  y-parallax. 


Ordinarily,  there  would  not  be  match  errors  in  an  autocorrelation  process.  However, 
because  the  computed  autocorrelation  function  is  seldom  symmetric  about  the  true 
match  point,  the  estimation  procedure  does  induce  small  errors.  The  averages  of  the 
errors  for  all  three  measures  of  similarity  were  less  than  0.0 1  of  the  sample  spacing. 
A  set  of  M  regularly  spaced  correlation  values  was  calculated  at  and  about  the  trial 
match  point  (in  this  test,  the  trial  match  point  is  the  exact  match  point),  and  the 
maximal  point  was  determined  by  regarding  the  correlation  function  as  quadratic. 
If  the  largest  (or  smallest  in  the  case  of  XDY)  of  the  M  discrete  correlation  values 
occurred  at  either  end  of  the  set,  then  a  warning  flag  was  activated.  There  were  no 
warnings  for  the  absolute  difference  measure  (XDY)  or  for  the  linear  correlation 
coefficient  measure  (RXY).  Eleven  lines  of  image  data  were  processed  in  the  auto¬ 
correlation  mode.  The  matching  window  sizes  were  varied  from  11  to  101  samples 
in  steps  of  10.  The  correlation  function  was  estimated  with  5  correlation  values 
per  match  and  with  7  values  per  match.  The  results  are  presented  in  tables  1  and  2. 
The  dashed  values  pertain  to  standard  errors  less  than  0.01  sample  spacing. 


An  attempt  was  made  to  match  all  possible  points.  The  number  of  trial  matches  per 
line  is  N  =  2050  -  M  -  L,  where  L  is  the  window  size.  Thus,  the  number  of  trial 
matches  per  line  is  varied  from  1 942  to  2034.  The  units  of  table  1  are  sample 
spacings,  whereas  the  units  of  table  2  are  counts. 
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TABLE  1.  Standard  Error  of  Mismatch  for  Autocorrelation 

of  Linear  Arrays 


RXY 

SXY 

XDY 

_M_ 

_M_ 

-M. 

Window 

Size 

_ 5_ 

7 

_ 5_ 

7 

5 

7 

11 

.08 

.08 

.27 

.40 

.03 

.03 

21 

.05 

.05 

.21 

.28 

.02 

.02 

31 

.03 

.03 

.17 

.23 

.01 

.01 

41 

.02 

.02 

.16 

.20 

.01 

.01 

51 

.02 

.02 

.14 

.17 

.01 

.01 

61 

.02 

.02 

.13 

.15 

.01 

.01 

71 

.01 

.01 

.12 

.13 

— 

— 

81 

.01 

.01 

.11 

.12 

— 

— 

91 

.01 

.01 

.10 

.11 

— 

— 

101 

.01 

.01 

.09 

.09 

_ 

_ 

TABLE  2.  Warning  Statistics  for  SXY 

0  WN 

Window 


Size 

J_ 

1_ 

11 

95 

79 

21 

18 

21 

47 

42 

16 

19 

31 

32 

29 

15 

17 

41 

22 

20 

13 

14 

51 

13 

14 

9 

11 

61 

10 

10 

7 

10 

71 

7 

8 

5 

8 

81 

4 

5 

5 

6 

91 

3 

4 

4 

5 

101 

2 

2 

3 

4 
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The  purpose  of  the  autocorrelation  experiment  was  to  evaluate  the  performance  of 
the  three  correlation  measures  under  ideal  conditions.  The  purpose  of  the  stereo 
experiment  was  to  evaluate  the  same  measures  under  more  realistic  conditions.  The 
stereo  process  was  initiated  at  line  1527.  The  most  recent  results  from  an  area  match¬ 
ing  exercise  were  used  to  shape  the  dependent  line.3  The  epipolar  matching  process 
proceeded  by  first  calculating  parallax  shifts  for  line  1527  and  then  using  the  derived 
results  to  shape  the  dependent  member  of  the  epipolar  pair  of  lines  associated  with 
line  1528.  The  process  continued  in  this  manner  and  was  halted  at  line  1542.  The 
following  statistics  were  recorded  for  each  of  the  16  lines: 


us  :  Average  x-parallax  shift 

os  :  Standard  deviation  of  the  computed  x-parallax 

WN  :  Number  of  warnings 

The  following  statistics  were  recorded  for  lines  1527,  1532,  1537,  and  1542: 

Au  :  Average  x-parallax  error 

ffAu :  Standard  deviation  of  x-parallax  error 

The  error  data  was  generated  by  comparing  coordinate  values  derived  in  the  epipolar 
process  to  those  derived  by  area  correlation.  There  were  390  such  comparisons  made 
over  the  four  lines.  The  results  are  presented  in  table  3. 


It  should  be  noted  that  line  pairs  of  data  used  above  are  not  exactly  epipolar  line  pairs. 
This  fact  explains  part  of  the  error  increase  as  more  lines  are  processed.  The  same  is 
true  in  the  third  experiment  where  y-parallax  is  used  to  detect  and  estimate  an 
epipolar  line  shift. 


3F.  Rays  Norvelle,  “Interactive  Digital  Correlation  Techniques  for  Automatic  Compilation  of  Elevation  Data,” 
U.S.  Army  Engineer  Topographic  Laboratories,  Fort  Belvoir,  VA,  ETL--0272,  October  1981. 
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TABLE  3.  Statistical  History  of  Stereo  Epipolar  Matching. 


If  the  instantaneous  relative  orientation  parameters  as  described  in  appendix  D  are 
known,  then  any  image  point  selected  on  the  left  (or  right)  image  uniquely  deter¬ 
mines  corresponding  epipolar  lines.  Since  the  defining  epipolar  plane  is  a  member  of 
the  family  of  planes  specified  by  the  base  line,  any  pair  of  points  selected  on  the  two 
lines  will  satisfy  the  coplanarity  condition.  However,  if  a  point  on  the  second  image 
is  selected  on  a  neighboring  epipolar  line,  the  resultant  ray  will  not  be  in  the  defined 
epipolar  plane  and  a  y-parallax  error  will  be  the  result.  In  table  4,  y— parallax  errors 
are  considered  as  a  function  of  line  error,  and  x— parallax  errors,  for  a  pair  of  lines 
selected  in  the  following  way.  A  line  of  data  on  the  left  image  was  selected  and  re¬ 
garded  as  an  epipolar  line.  Forty  points  (25  pixel  spacing)  were  selected  along  this 
line,  and  the  corresponding  epipolar  line  was  defined  by  the  40  match  points  de¬ 
termined  in  the  area-matching  experiment  referenced  above.  Errors  were  introduced, 
and  y-parallax,  expressed  as  AYp2  in  appendix  D,  was  computed  and  tabulated. 


TABLE  4.  y  —  Parallax  Errors. 


x  -  Parallax 


Errors 

0 

10 

0 

0.3 

10.3 

25 

0.6 

10.6 

50 

0.9 

10.9 

75 

1.2 

11.2 

LINE  ERRORS 


20 

30 

40 

20.3 

30.3 

40.3 

20.6 

30.6 

40.6 

20.9 

30.9 

40.9 

21.2 

31.2 

41.2 

60 

80 

100 

60.3 

80.3 

100.3 

6,\6 

80.6 

100.6 

60.9 

80.9 

100.9 

61.2 

81.2 

101.2 

The  entries  in  table  4  are  average  y-parallax  errors  expressed  in  sample  spacings. 
That  the  two  lines  are  not  exactly  epipolar  pairs  is  indicated  by  the  increase  in  y- 
parallax  as  x-parallax  errors  increase.  The  y-parallax  deviation  from  the  ideal  y- 
parallax  value  (induced  line  error)  ranges  from  0.3  sample  spacing  to  1.2  sample 
spacing  as  x-parallax  error  ranges  from  0  to  75  sample  spacing.  This  bias  holds 
over  the  entire  range  of  induced  errors.  The  standard  deviation  for  each  entry  is  0.7 
sample  spacing.  The  range  of  deviations  for  each  entry  of  table  4  was  estimated 
from  the  error  results  and  found  to  be  (  AY  -0.8)  <  R  <  (  AY  +  0.2)  for  all  cases. 
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The  fact  that  XDY  performed  better  than  RXY  in  the  autocorrelation  of  epipolar 
data  was  not  surprising  since  a  similar  result  was  achieved  under  another  autocorre¬ 
lation  test.4  The  relatively  poor  performance  of  the  co- 
DISCUSSION  variance  function  SXY  was  not  too  surprising  since  there  is 
no  gaurantee  that  the  exact  match  point  will  produce  the 
largest  covariance  value.  Generally  it  will,  but  there  are  many  cases,  especially  when 
small  windows  are  used  in  busy  areas,  where  SXY  will  not  produce  a  maximum  at  the 
true  match  point.  This  fact  is  highlighted  by  the  large  standard  deviations  in  table  1 
and  by  the  large  number  of  warnings  in  table  2.  Warnings  were  given  whenever  the 
largest  of  the  measures  (SXY)  occurred  at  the  end  of  a  set  of  M  measures.  There 
were  no  warnings  for  XDY  or  for  RXY  in  the  autocorrelation  tests. 


The  measure  of  similarity  RXY  proved  to  be  superior  to  both  XDY  and  SXY 
in  the  stereo  tests  (see  table  3)  and  SXY  was  shown  to  perform  better  than  XDY. 
This  result  is  consistent  with  previously  referenced  studies  (see  2  and  3)  and  with 
results  taken  from  a  passpoint  study.5  The  measure  RXY  is  not  affected  by  an  addi¬ 
tive  or  multiplicative  luminance  difference  between  images  of  the  same  scene.  The 
measure  SXY  is  unaffected  by  an  additive  difference,  whereas  XDY  is  affected 
by  both  distortions. 


The  primary  reason  for  considering  SXY  over  RXY,  and  XDY  over  both,  is  ease 
of  computation.  The  computing  time  for  the  similarity  measures  is  the  largest  single 
item  in  the  compilation  computing  time  budget  and  any  worthwhile  savings  should 
be  exploited.  The  additive  and  multiplicative  effects  in  RXY  or  the  additive  effects 
in  SXY  can  be  accounted  for  in  one  pass  of  the  data;  however,  two  passes  would 
be  necessary  to  compute  either  of  the  modifications  of  XDY  given  below: 


N 

XDY  A  =  1/N  £|(Xi-X)-(  Yi-Y) 

i  =  1 


4 

M'chael  A.  Crombic,  Philip  G.  Le:n,  and  Thomas  A.  Hay,  Single  Photo  Analysis  of  Sampled  Aerial  Imagery, 
U.S.  Army  Engineer  Topographic  Laboratories,  Port  Belvoii,  VA,  ETL-RN-74-10.  August  1974,  ADA012  176. 

‘'Michael  A.  Crombic,  Semi-automatic  Passpoint  Determination  Using  Digital  Techniques,  U.S.  Army  Engineer 
Topographic  Laboratories,  Tort  Belvoii,  VA,  F.TL-0051,  December  1975,  AD-A026  082. 
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XDYAM 


N 

=  1/N  £  |(Xi-X)/ox-(Yi-Y)/oy| 

i  =  1 

Tests  should  be  conducted  to  determine  whether  either  of  these  measures  is  superior 
to  RXY  in  stereo  tests. 


One  purpose  of  this  study  was  to  explore  the  possibility  of  real  time  calculation  of 
terrain  elevation  data.  Although  the  data  used  for  the  tests  were  not  exact  epjpolar 
data,  the  results  definitely  show  that  it  would  be  extremely  risky  to  rely  on  a  totally 
automated,  unmonitored  correlation  process.  The  process  described  in  this  report 
traveled  across  only  16  epipolar  lines  (about  65  feet),  yet  a  glance  at  table  3 
shows  the  process  coming  apart.  Processing  refinements,  such  as  using  XDYA  as 
XDYAM,  or  employing  a  modified  area  matching  concept  with  epipolar  data6  might 
produce  acceptable  results,  but  it  is  doubtful.  Consideration  would  have  to  be  given 
to  obscuration  due  to  clouds  and  to  loss  of  correlation  due  to  water,  featureless  terrain, 
etc.  Since  most  of  these  nuisances  have  not  been  addressed  satisfactorily  in  a  con¬ 
trolled  environment,  it  is  highly  unlikely  that  the  real  time  collection  of  terrain  eleva¬ 
tion  data  can  be  realized  in  the  near  future. 


However,  photogrammetric  relations  can  be  used  to  aid  in  data  acquisition  for  sub¬ 
sequent  and  efficient  data  processing.  It  is  not  necessary  that  all  y-parallax  be  removed 
before  compilation.  For  example,  the  data  used  for  the  experiments  in  this  study 
contain  some  y-parallax,  yet  the  digitized  images  can  be  viewed  quite  satisfactorily 
in  anaglyph  form,  and  conventional  digital  correlation  processes  were  used  to  compute 
elevation  data.7,8  Near  epipolar  data  was  obtained  by  transferring  principal  points 
between  the  image  transparencies  and  then  placing  the  transparencies  in  the  scanner 
so  that  the  approximate  base  line  projection  was  parallel  to  the  scan  axis.  The  epipolar 
notion  is  discussed  in  appendix  D  and  shown  in  figure  1 . 


8 F rank  Scarano  and  Gerry  Brumm,  “A  Digital  Elevation  Collection  System,”  Photogrammetric  Engineering  and 
Remote  Sensing,  Vol.  XL1I,  No.  4,  April  1976. 

Michael  A.  Crombie,  Stereo  Analysis  of  a  Specific  Digital  Model  Sampled  From  Aerial  Imagery,  U.S.  Army 
Engineer  Topographic  Laboratories,  Fort  Belvoir.  VA,  ETL-0072,  September  1976.  AD-A033  567. 

g 

F.  Raye  Norvelle,  “Interactive  Digital  Correlation  Techniques  for  Automatic  Compilation  of  Elevation  Data,” 
U.S.  Army  Engineer  Topographic  Laboratories,  Fort  Belvoir,  VA,  to  be  published. 
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If  there  is  a  fixed,  or  predictable,  relative  orientation  between  the  two  exposures, 
then  the  following  relation  holds: 


Cp  =  P,XP2  *B  =  0 


The  vectors^  P2  and  B  are  functions  of  the  relative  orientation  parameters  and, 
along  with  P. ,  are  described  in  appendix  D.  If  the  six  relative  orientation  parameters 
defined  in  appendix  D  are  known,  or  estimated,  then  the  parameters  plus  any  point, 
q,  for  example,  will  uniquely  determine  the  epipolar  lines  £q,  and  £q2.  If  the 
relative  orientation  data  is  correct,  then  any  point  on  £q2  along  with  q,  (or  any 
point  on  8q, )  will  satisfy  the  vector  equation  given  above. 


To  clarify  some  of  the  ideas  with  numerical  examples,  the  author  conducted  the 
experiment  described  previously.  It  was  assumed  then  that  the  relative  orientation 
data  was  correct  and  that  the  scanned  data  was  in  fact  epipolar  data.  Large  line  errors 
and  large  x-parallax  errors  were  induced  on  the  second  image,  and  the  line  shifts 
were  estimated  using  the  AYp2  correction  given  in  appendix  D.  The  rest  "s  are 
Listed  in  table  4  and  show  a  close  approximation  to  the  induced  errors. 


Using  the  AYp2  correction  given  in  appendix  D  implies  that  the  relative  orientation 
parameters  are  correct  and  that  the  correct  line  is  selected  on  the  left  image.  In  this 
instance,  y-parallax  is  due  entirely  to  not  selecting  the  corresponding  line  on  the  right 
image.  Effectively  using  the  coplanarity  condition  equation  requires  that  the  acquisi¬ 
tion  system  be  under  control  and  that  the  relative  geometry  for  the  stereo  imaging 
system  be  considered.  For  example,  consider  Model  1  described  in  appendix  A. 
In  this  model,  the  design  relative  orientation  parameters  are  given  below. 


2  1 


Cos  26  0 

0  1 
Sin  20  0 


B  = 


15 


where 


0  :  camera  pitch 

6x:  x  -  component  of  relative  baseline. 


From  appendix  D, 


J,  - 

Ypj  Sx  Tan 0 

X'p2 

=  f  Sin  20 

h  - 

f6x 

y'p2 

=  yp2 

J3  - 

Yp,6x 

zp' 

=  -f  Cos  20 

Cp  = 

f5 x  (Y p2  -  Ypj) 

=  0 

f  = 

camera  focal  length 

Assume  that  an  attempt  will  be  made  to  maintain  the  fixed  relative  orientation  of 
Model  1  over  time.  The  following  linear  correction  equation  can  be  used  to  correct 
relative  orientation  whenever  the  relative  orientation  is  sampled  from  exterior  orienta¬ 
tion  data.  Let  the  three  fundamental  angles  of  A21  be  roll,  pitch,  and  yaw  (go,  0, 
k),  then 

co  =  0 

0  =  -20 
K  =  0 


The  linear  correction  equation  is 


E 

e 


acp 

W~ 


A£  =  -Cp 


£  =  6x,  5y,  6z,  co,  0,  k 
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The  coefficients  of  the  corrections  are  obtained  by  a  straightforward  partial  differen¬ 
tiation  of  the  coplanarity  relation  with  respect  to  the  pertinent  relative  orientation 
parameters. 


acp 

— -  =  f(  Yp2  -  Yp,Cos  26) 


3Cp 

36y 


f2  Sin  26 


3Cp 

35z 


fVp,  Sin  26 


3Cp 

3cj 


-  6 x  ( f 2  +  Yp,Yp2) 


3Cp 

30 


SxYpjfiSin  26  +  Tan  6  Cos  26) 


3Cp 

5k 


6x(f2  Sin  26  +  YpjYp.,  Tan0) 


Note  that  in  Model  1  Ypj  =  Yp2-  Several  detectors  could  be  selected  over  the 
array  to  produce  observation  equations  for  input  to  a  Kalman  type  fiber  for  a  se¬ 
quential  adjustment  over  time.  Since  the  relative  orientation  parameters  are  them¬ 
selves  functions  of  exterior  orientation  parameters,  the  basic  condition  equation  can 
be  modified  to  reflect  indirect  observations  on  the  exterior  orientation  data. 


The  same  kind  of  analysis  can  be  applied  to  the  Model  2  acquisition  system.  There, 
several  fixed  relative  orientations  would  be  maintained  since  the  desired  relative 
orientation  is  a  dynamic  one. 


v  -  'r.M  v*#**'*-#***-**^ 


17 


1.  Real  time  collection  of  elevation  data  using  epipolar 
correlation  techniques  is  not  feasible. 

CONCLUSIONS 

2.  A  modification  of  the  absolute  difference  measure  of 
similarity  should  be  evaluated  to  determine  whether  it 
provides  a  worthwhile  improvement  over  the  more 
conventional  linear  correlation  measure. 

3.  Real  time  mensuration  of  y-parallax  can  be  used  as  a 
means  to  help  maintain  a  desired  relative  orientation  in 
a  variety  of  digital  collection  systems. 


Digital  Stereo  Model  1  ■  The  sensor  is  defined  to  be 

a  linear  array  of  rectangular,  solid-state  detectors  located 
APPENDIX  A.  f  units  (f  *  focal  distance  of  the  lens)  from  the  rear 
nodal  point  of  the  lens.  The  camera  is  regarded  as  a  thin 
framelet  as  shown  in  figure  A1 . 


z 


The  origin  of  the  camera  coordinate  frame  is  located  at  the  rear  nodal  point  of  the 
lens,  with  the  x-axis  oriented  toward  the  flight  direction.  The  detectors  are  rectan¬ 
gular  with  dimensions  Ax  and  Ay. 


Model  1  is  similar  to  a  strip  camera  mode  where  a  narrow  slit  is  perpendicular  to 
the  flight  direction  and  the  film  is  moved  past  the  slit  at  image  point  speed.  Ground 
coverage  is  obtained  by  a  moving  vehicle  whose  velocity  and  flying  height  are  used 
to  determine  the  image  point  speed.  Stereo  ground  coverage  is  obtained  by  employing 
two  such  systems  in  the  vehicle  where  the  optical  axes  are  pitched  toward  one  another. 
In  the  digital  system,  ground  reflectance  data  is  read  out  of  the  detectors  and  trans¬ 
mitted  rather  than  recorded  on  film. 


The  forward  camera  of  the  stereo  pair  is  described  in  figure  A2. 
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X 


Flight  Direction 


0 :  Camera  Pitch 


FIGURE  A2.  Model  1  Forward  Camera. 


tie  geometric  relationship  between  points  in  the  linear  array  and  its  projection  on  the 
-plane  is  expressed  by  the  following  colinear  relation: 


where 

fip  =  y/  Xp2  +  yp2  +  f2 

Lp  =  ,/xp2  +  Yp2  +  H2 

P  is  any  point  on  the  projection  of  the  array. 
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The  xp-coordinate  is  zero  in  this  model.  Line  number  (or  exposure  time)  is  used 
in  place  of  y-coordinates.  The  ground  dimensions  of  a  projected  detector  (foot¬ 
print  size)  is  computed  next. 


The  image  coordinates  are  derived  directly  from  the  colinearity  model, 

,  Xp  Cos  0  -  H  Sin  0 

xp  =  f  -  =  0 

Xp  Sin  0  -  H  Cos  0 

or  Xp  =  H  Tan  0 
yp  =  -[7  Yp  Cos  9 

ri 


The  footprint  dimensions  are  obtained  by  differentiating  the  expressions  for  xp 
and  yp,  respectively,  and  then  letting  Xp  =  H  Tan  9. 

AX  =  H/fSec2  0Ax 
Ay  =  H/f  Sec0Ay 


The  aft  camera  is  essentially  the  same  as  the  forward  camera  except  that  the  pitch 
angle  is  in  the  opposite  direction.  The  diagram  in  figure  A3  is  a  profile  of  the  two 
cameras  when  the  same  ground  line  is  imaged. 


21 


z 


z 


The  base  line  distance  B  -  2H  Tan  0  can  be  used  to  determine  the  model  exposure 
interval  if  the  vehicle  speed  V  is  known,  i.e.  AT  =  2H/V  Tan  0.  Note  that  since 
the  projection  of  the  linear  array  is  perpendicular  to  the  ground  track, the  output  of 
the  Jth  detector  on  the  forward  camera  and  the  output  of  the  Jth  detector  on  the 
aft  tor  all  exposures  constitute  an  epipolar  stream  of  reflectance  values.  This  is  true 
for  all  J  -  I,  N  detectors,  as  long  as  the  relative  geometry  described  above  is  main¬ 
tained.  If  the  relative  geometry  is  maintained  over  time,  then  the  Jth  pixel  at  time 
Tj  on  the  forward  array  corresponds  to  the  Jth  pixel  at  time  (T,  +  AT  +  6T)  on 
the  aft  array.  The  time  shift  6T  pertains  to  x-parallex  because  of  an  elevation  value 
other  than  zero.  The  x-parallax  is  determined  by  correlation  methods  using  the  two 
sets  ot  corresponding  epipolar  data  sampled  at  the  Jth  detectors  over  time. 
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Digital  Stereo  Model  2  ■  The  sensor  coordinate  frame 

APPENDIX  B.  here  is  the  same  as  in  Model  1  except  that  the  linear  airay 
of  detectors  is  toward  the  flight  direction  (see  figure  B1 ). 


FIGURE  BI.  Model  2  Camera  Coordinate  Frame. 


Model  2  is  similar  to  a  panoramic  scanning  mode  where  a  narrow  slit  is  arranged  in 
the  flight  direction  and  the  lens  system  is  rotated  across  the  flight  path  to  acquire 
ground  coverage.  Again,  as  in  the  first  model,  stereo  coverage  is  obtained  by  employing 
two  such  systems  in  the  vehicle  where,  again,  the  optical  axes  are  pitched  toward  one 
another.  As  before,  digital  data  is  read  out  of  the  detectors  and  transmitted  rather 
than  stored  on  film. 


The  forward  camera  of  the  stereo  pair  is  described  in  figure  B2. 
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FIGURE  B2.  Model  2  Forward  Camera. 


2. 


The  relationship  between  points  in  the  linear  array  and  its  projection  in  the  XY-plane 
is  expressed  by  the  following  colinear  model: 


/  xp  \  fl  0  0  \/ Cos  0  0  Sin  d\  lx  p  \ 

(  yp  1  1/fip  =  0  Cos0p  Sin/3p|j  0  1  Oil  Yp  J  1/Lp 

\  -f  J  \  -  Sin  Pp  Cos  Pp J  \-Sin  0  0  Cos  6 J  ^-H  J 

where 

lp  =  (xp2  +  yp2  +  f2  )'A 
Lp  =  (Xp2  +  Yp2  +H2)* 

P  is  any  point 


The  instantaneous  yp-coordinate  is  always  zero  in  this  mode  since  the  linear  array 
of  detectors  is  regarded  as  a  straight  line  in  the  focal  plane.  By  setting  yp  =  0,  the 
following  pair  of  equations  can  be  derived  from  the  colinearity  model : 


xp 


0P 


and 


-fCos  Pp 


!  XpCos  0  -  HSin  0 
-XpSin  0  -  HCos  0  , 


Tan-1 


_ 32 - ) 

XpSin  0  +  HCos  0  / 


Xp 


xpCos  0  +  fSin  0  Cos  Pp 
xpSin  0  -  fCos  0  Cos  Pp 


Yp 


fSin  Pp 

xpSin  0  -  fCos  0  Cos  Pp 


The  angle  cc  is  the  angle  between  the  epipolar  plane  trace  in  the  XY-plane  and  the 
zx-plane  trace  in  the  XY-plane.  It  is  assumed  here  that  the  flight  path  is  parallel 
to  the  X-axis.  The  tangent  of  u  is  d~YP  where  P  is  any  point  on  the  array  (see 
figure  B3).  9Xp 
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FIGURE  B3.  Model  2  Interior  Geometry. 


From  the  diagram,  xp  =  fTanXp,  and  from  the  ground  point  formulas, 

3Y  _  HSin  0  Sec2  XpSin  6 _ 

3Xp  (Tan  X  pSin  9  -  Cos  9  Cos  P  )2 

3X  _  -HSec  X  pCos(3 

3Xp  (Tan  X  pSin  6  -  Cos  9  Cos  j3  )2 


3Y 

3Y  _  3X 

3X  ~  3X 

3X 


Tan  co  =  -Tan  (3  Sin  9 
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The  X  -footprint  dimension  along  the  projection  of  the  linear  array  is  computed 
next.  From  the  relation  Tan  (X  +  AX)  =  (x  +  A  x)/f, 


fSec2  X  A  X 
1  -  A  X  Tan  X 


and 


AX  £s. 


A  x 

fS*ca  X  +  A  x  Tan  X 


The  rate  of  change  of  X  with  respect  of  x  is 


3X 

dx 


ax 

lim  A  X  =  lim  3X 
Ax-K)  A  x  Ax-K)  3x 

"ax 


HSec2  X  Cos  0 
(Tan  X  Sin  0  -  Cos  0  Cos  0)' 
fSec^  X 


H  _ Cos  0 _ 

f  (Tan  X  Sin  8  —  Cos  0  Cos  0  )z 


Let 


ax' 

3x 


be  the  rate  of  change  along  the  array  projection,  then 


dX  dX  /  _  H  Cos  1  +  Sin2  0  Tan2  0 

3x  3x  t  f  (Cos  0  Cos  0  -  Tan  X  Sin  6)2 

then  the  X- footprint  dimension  is 

Cos  0  y/  \  +  Sin2  0  Tan2  0 
(Cos  0  Cos  0  -  Tan  X  Sin  0)2  Ax 
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The  Y'  -footprint  dimensions  along  the  projection  of  the  scan  axis  is  computed  next. 
The  projection  angle  6  is  computed  in  the  following  way: 


Tan  6 


ax 

M. 

ay 

dP 


ax  _  H  Tan  X  Sin  p _ 

dp  (Tan  X  Sin  8  —  Cos  8  Cos  P)2 

3Y  _  H  (Cos  8  -  Tan  X  Sin  8  Cos  p  ) 

dp  (Tan  X  Sin  6  -  Cos  0  Cos  P  )2 

and 

_  c  Tan  X  Sin  P 

Tan  6  =  - 

Cos  8  -  Tan  X  Sin  8  Cos  P 


Cos  5 


7 


i 

1  +  Tan^  X  Sin2  p 

(Cos  8  -  Tan  X  Sin  8  Cos  p  ) 2 


3Y 

dy 


3Y  dp  _  H  Cos  8  -  Tan  X  Sin  8  Cos  P 

dp  dy  f  (Tan  X  Sin  8  -  Cos  8  Cos  P  )2 


3Y 

3y 


Cos  5 


H 

f 


— -  ■” 

(  yj (Cos  8  -  Tan  X  Sin  8  Cos  P)2  +  Tan2  X  Sin2  P 
[  ~  (Tan  X  Sin  8  -Cos  8  Cos  P)^ 


Then  the  Y -footprint  dimension  is 

^ ,  _  H  y/  (Cos  8  -  Tan  X  Sin  8  Cos  P)2  +  Tan2  X  Sin2  P  Ay 

f  (Tan  X  Sin  8  -  Cos  8  Cos  p  )2 
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The  aft  camera  is  essentially  the  same  as  the  forward  camera  except  that  the  pitch 
angle  is  in  the  opposite  direction.  Note  that  the  epipolar  trace  is  parallel  to  the  ground 
X-axis,  but  because  of  the  pitch,  the  projection  of  the  array  is  not  parallel  to  the 
epipolar  trace.  Furthermore,  the  projection  of  the  aft  array  for  the  same  sweep  angle 
0  also  makes  an  angle  oj  with  respect  to  the  epipolar  trace,  but  in  the  opposite 
direction.  This  means  that  there  is  a  relative  skew  between  forward  and  aft  data  and 
that  the  skew  varies  with  0.  It  is  shown  below  that  the  relative  skew  in  the  image 
domain  is  not  2cj.  In  fact,  because  of  the  scan  procedure,  the  focal  plane  must  be 
regarded  as  a  section  of  a  cylinder.  As  a  result,  the  projection  of  the  epipolar  trace 
onto  the  cylindrical  focal  plane  is  not  even  a  straight  line. 


The  equation  for  the  projection  of  the  epipolar  trace  onto  the  cylindrical  focal  plane 
is  derived  in  appendix  C.  Assume  for  the  present  that  the  cone  angle  of  the  camera 
is  small  enough  so  that  the  curved  line  can  be  approximated  by  a  straight  line.  The 
slope  of  the  approximate  straight  line  is  computed  next. 


The  slope  of  the  projection  of  the  epipolar  trace  with  respect  to  the  camera  x-axis 
at  xp  =  0  is  K  where 


ay 

ax _ 

dx 

ax 

From  the  colinearity  relations, 

dx  _  fHCos  0 
3X  ”  (XSin  0  +HCos0)2 


fYSin  6  Cos2  0 
(XSin  6  +  HCos  0)2 


3y  _  3y  d0 

3X  ’  ~d0  ax 


TanK 


_  ay  _ 
3x 


dy 

d0 


=  f 
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dp  =  -YSin  0  Cos2  P 

Tk  ~  (XSin  9  +  HCos  9)2 


then 


TanK 


Sin  9  Cos  P 


and  from  the  colinearity  relations, 


Y(xp  =  0) 


HSin  P 
Cos  6  Cos  P 


and  finally 


TanK  =  -Tan  6  Sin  p 


Epipolar  data  cannot  be  extracted  from  corresponding  pixels  over  time  when  Model 
2  is  used.  In  fact,  a  complex  sampling  procedure  requiring  expensive  buffer  storage 
must  be  developed  if  epipolar  data  is  processed  in  flight.  This  problem  can  be  eased 
if  one  more  degree  of  freedom  is  introduced  into  the  scan  procedure.  If  the  optical 
axis  of  the  rotating  camera  is  yawed  by  an  angle  K  =  Tan*1  (-Tan  9  Sin  P)  during 
scan,  then  the  projection  of  the  epipolar  trace  will  be  coincident  with  the  linear  array. 
Image  data  from  the  forward  and  aft  cameras,  for  the  same  sweep  angle,  will  be  corres¬ 
ponding  epipolar  data. 


There  is  still  the  problem  of  collecting  epipolar  data  from  the  forward  and  aft  cameras 
in  a  practical  manner.  If  the  two  cameras  are  rotated  in  the  same  direction  so  that  the 
sweep  angles  are  identical  for  a  given  time,  then  epipolar  data  can  be  processed  when 
collected.  Such  a  scan  procedure  will  introduce  a  vehicle  rotational  effect  that  must 
be  countered.  If  the  two  cameras  are  rotated  in  opposite  directions  so  that,  for  ex¬ 
ample,  both  view  the  nadir  epipolar  trace  at  the  same  time,  then  the  vehicle  rotational 
effect  is  cancelled,  but  corresponding  epipolar  lines  of  data  off  ground  nadir  are 
collected  at  dirrerent  times.  This  introduces  storage  problems  for  near  real  time  pro¬ 
cessing. 
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APPENDIX  C. 


Equation  of  Epipolar  Trace  on  Cylindrical  Focal  Plane  • 
Assume  that  the  stereo  model  is  as  defined  in  appendix  B, 
then  from  the  colinearity  relations 


Y  Cot  0  =  X  Sin  0  +  H  Cos  0 
or 

X  =  Y  Csc  0  Cot  0  -  H  Cot  0 


Substitute  this  expression  for  X  into  the  first  of  the  colinearity  equations,  and  after 
some  algebraic  simplication,  the  result  is 


Sin  0  x  +  H  Sin  0 


Y  Cos  0  Cos  0 


Note  that  if  an  xy-coordinate  frame  is  defined  on  the  cylindrical  section,  then  y  =  f*0 
or  0  =  y/f.  The  objective  here  is  to  square  the  above  equation  and  solve  the  resulting 
quadratic  equation  for  Sin  0.  The  result,  after  some  algebraic  simplication  is 


x  Y  H  Sin  0 


+  Y  Cos  0  J Y2  Cos2  0  +  H2  - 


x2  Y2 


Sin2  0 


Sin  0  =  - 


H2  +  Y2  Cos2  0 


and  finally 


=  f  Sin'1  < 


Y  cos  0  y/Y2  Cos2  0  +  H2  - 


x2  Y2  Sin2  6  xYH  Sin2  6 


H2  +  Y2  Cos2  0 


The  projection  of  the  epipolar  trace  onto  the  cylindrical  focal  plane  is  described  in 
figure  Cl. 
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X 


Sweep  Direction 

Approximate  Epipolar  Line:  _ 
Exact  Epipolar  Line: 

FIGURE  Cl.  Epipolar  Line. 


The  difference  between  the  exact  and  approximate  epipolar  lines  is  greatly  exaggerated 
in  the  diagram.  Consider  the  following  example  where  the  pitch  is  6  =  10°  and  where 
I  x/f  l  <  0.1.  This  example  provides  a  forward  field  of  view  of  11.42°.  Let  0  =  -  30° 
then  K  =  5.038°.  If  the  focal  length  is  30  inches  (76cm),  then  lx  I  <  3.0  inches 
(7.6cm)  and  the  exact  epipolar  line  is  expressed  in  table  Cl.  Note  that  the  second 
differences  are  insignificant,  which  means  that  the  y-values  can  be  represented  as  a 
linear  function  of  the  x-values. 


or 


y  =  -15.70796331 
y  =  -15.70796331 


+  x  *  Tan  K 
+  0.088163490  *  x 
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TABLE  Cl.  Epipolar  Line  Example. 


X 

y 

Ay 

A2y 

-3.0 

-15.97245721 

-2.4 

-15.91955744 

.05289977 

-1.8 

-15.86665834 

.05289910 

-.00000067 

-1.2 

-15.81375972 

.05289862 

-.00000048 

-0.6 

-15.76086114 

.05289828 

-.00000034 

0.0 

-15.70796331 

.05289813 

-.00000015 

0.6 

-15.65506518 

.05289813 

.0 

1.2 

-15.60216691 

.05289827 

.00000014 

1.8 

-15.54926829 

.05289862 

.00000035 

2.4 

-15.49636919 

.05289910 

.00000048 

3.0 

-15.44346942 

.05289977 

.00000067 

0  = 

10° 

0  = 

1 

u> 

o 

o 

f  = 

30" 
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APPENDIX  D. 


Coplanarity  Condition  Equation  ■  The  coplanarity  con¬ 
dition  requires  that  the  base  line  between  lens  positions  of 
two  exposures  and  the  two  imaging  rays  of  a  common 
ground  point  be  coplanar.  The  relevant  geometry  is  shown  in 
figure  Dl. 


FIGURE  Dl.  Relative  Geometry. 


Define  A2 ,  as  the  (3  x  3)  rotation  matrix  that 
directions  in  scene  I .  Express  the  two  imaging  rays  p 


relates  directions  in  scene  2  to 
,  and  p2  in  scene  1. 
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Define  the  baseline  vector  B  as  a  set  of  direction  numbers  describing  the  direction  of 
lens  2  from  lens  1  in  scene  1 . 


\6z 

If  the  two  imaging  vectors  P,  and  P2  are  to  intersect  at  P,  then  B,  Pj ,  and  P2 
must  be  coplanar.  Coplanarity  is  assured  if  the  following  vector  equation  is  satisfied: 


Cp  =  P,  X  P2  •  B  =  0 
If  Cp  is  expanded,  then  the  equation  takes  the  form 


Cp  =  J,  x'  p2  +  J2  y'  p2  +  J3  z'  p2  =  0 
J,  =  -f,  6y  -yp,  6z 

J2  =  f,  6x  +  xp,  6z 

J3  =  yp,  8\  -  xp,  5y 

The  rotation  matrix  A2,  can  be  uniquely  defined  by  three  angles  a,,  a2,  and  a3. 
It  can  be  shown  that  only  five  of  the  six  relative  orientation  parameters  (6x,  Sy.  6z, 
ai  -  a2>  “3)  are  independent,  that  is,one  of  the  six  parameters  must  be  held  constant. 
Note  that  the  coplanarity  condition  is  independent  of  the  ground  point  P.  The 
condition  requires  only  that  the  three  vectors  B,  P, ,  and  P2  be  coplanar.  For 
example,  if  errors  in  xp, ,  xp2,  or  both  are  made  along  their  respective  epipolar 
lines  (x-parallax  errors),  then  the  coplanarity  condition  is  unaffected.  However, 
errors  in  y  (y-parallax  errors)  are  readily  detected. 


If,  for  example,  the  relative  orientation  data  is  held  constant  along  with  (xp, ,  yp, ), 
then  the  y-parallax  error  is 
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Ayp 


2  a2  2  ^2  ^  a3  2  ^3  ) 


where  atj  are  from  A,  , . 


In  general,  corrections  to  the  four  coordinates  can  be  obtained  by  a  Taylor  expansion 
about  the  four  coordinates  and  retaining  only  the  constant  and  first  order  terms. 


3Cp  9Cp 

Cp  +  - —  Axp,  +  - —  Ayp, 
3xp,  3yp, 


dCp 

dxp. 


Ayp, 


acp 

9yp2 


Ayp, 


o 


where 


=  6zy'  p2  -  6y  z'  p2 


-  =  5X  z'  p,  -  bzx'  p, 

ayp, 


acp 

axp2 


*i  i  'i 


J,  +  A,,  J  +  a 


21  1 


31  3 


acp 

3yp, 


31 2  J1  +  a22  J2  +  a32  J3 
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Epipolar  Correlation  ■  Epipolar  correlation  pertains  to 
one-dimensional  image  matching  along  corresponding  lines 
APPENDIX  E.  of  data  over  which  y-parallax  does  not  exist.  Epipolar  data 
is  generated  by  a  member  of  the  family  of  planes,  each 
member  having  as  a  common  element  the  straight  line  con¬ 
necting  two  or  more  exposure  stations.  Consider  two  overlapping  frame  camera  ex¬ 
posures.  An  epipolar  line  pair  results  from  the  intersection  of  the  associated  epipolar 
plane  and  the  two  focal  planes.  An  example  of  this  geometry  is  presented  in  figure  D1 . 
In  that  example,  the  epipolar  plane  is  defined  by  the  baseline  vector  B  and  the  ground 
point  P. 


Model  2,  described  in  appendix  B,  produces  curved  epipolar  lines  that  in  most 
practical  cases  can  be  approximated  by  straight  lines.  An  example  of  this  geometry 
is  presented  in  figure  Cl.  Model  1,  described  in  appendix  A,  produces  streams  of 
epipolar  data  collected  over  time  from  corresponding  detectors. 


Since  epipolar  data  is  derived  from  imagery'  defined  by  a  plane  containing  the  photo¬ 
graphic  base  line,  then  all  corresponding  points  satisfy  the  coplanarity  condition 
equation  described  in  appendix  C.  As  a  result,  there  is  no  y-parallax  associated  with 
such  data.  In  fact,  any  pair  of  points,  one  point  from  the  first  line  and  the  other  any 
point  from  the  second  line,  will  satisfy  the  coplanarity  relation.  There  is  no  analytical 
condition  equation  that  will  produce  corresponding  points  along  the  epipolar  pair 
of  lines,  because  the  relative  positions  of  corresponding  image  points  are  directly  re¬ 
lated  to  unknown  terrain  elevations.  Numerical  correlation  techniques  are  used  to 
remove  x-parallax  or  to  determine  corresponding  points  on  epipolar  line  pairs. 


The  match  process  employed  in  this  study  is  described  next.  One  of  the  basic  notions 
is  that  the  match  process  is  a  refinement  process  rather  than  a  search  process.  Regu¬ 
larly  spaced  image  data  is  selected  from  the  first  line,  and  the  second  line  is  “shaped” 
to  reflect  the  expected  x-parallax.  Shaping  is  accomplished  by  using  results  from  a 
previously  matched,  nearby  line  pair,  that  is,  the  spacings  of  corresponding  points 
along  the  second  line  are  assumed  to  be  exactly  like  those  of  the  previous  second  line. 
Every  possible  point  is  matched  by  developing  a  set  of  correlation  functions  and  deter¬ 
mining  their  maximal  points.  Three  measures  of  similarity  are  evaluated  in  this  study 
to  develop  the  correlation  functions. 
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Digital  image  data  from  the  first  line. 
Digital  image  data  from  the  second  line. 


